THE BELL SYSTEM 

TECHNICAL JOURNAL 

Volume 48 February 1969 Number 2 

Copyright © 1969, American Telephone and Telegraph Company 

The Application of Delta Modulation 
to Analog-to-PCM Encoding 

By DAVID J. GOODMAN 

(Manuscript received September 24, 1968) 

This paper describes a pulse code modulation (PCM) encoder that 
employs a delta modulator as the analog-to-digital converter. A tapped 
binary shift register and an up-down counter cause delta modulation 
signals to be converted to a uniformly quantized PCM format. When tap 
weights are optimized with respect to a minimum mean square error criterion, 
the number of shift register stages necessary to obtain a fixed level of output 
quantizing noise varies inversely with delta modulation sampling rate. 
Because the tap weights may be rounded to a modest number of binary 
places, the arithmetic operations are simple to implement. A significant 
portion of the delta modulation-to-PCM converter may be time shared 
among several signals. 

I. INTRODUCTION 

Although delta modulation (AM) has been the subject of many 
theoretical and experimental studies, instances of its practical ap- 
plication are, to date, rare. In commercial systems, the most prominent 
digital representation of continuous signals is pulse code modulation 
(PCM). Relative to PCM, AM has the advantage of admitting sim- 
pler means of analog-to-digital and digital-to-analog conversion. 
However, the AM sampling rate is higher than that of PCM and in 
many cases the transmission rate is also higher. 

Since the discovery of delta modulation in the early 1950's, 1, 2 in- 
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vestigators have proposed various modifications of the elementary, 
single-integration AM system (for example, double integration AM 2 , 
high information AM 3 , continuous AM 4 ) for the purpose of decreasing 
the required sampling rate. Generally, lower rates are achieved by 
means of operations on the continuous signals presented to and ap- 
pearing in the delta modulator and thus at the expense of equipment 
complexity. 

In this paper we propose a PCM encoder that incorporates the sim- 
ple single-integration delta modulator and a transversal digital filter 
that converts the AM sequence to a uniformly quantized PCM se- 
quence. For this encoder, we demonstrate an inverse relationship be- 
tween the AM sampling rate and the number of digital filter stages 
required to achieve a specified level of PCM quantizing noise power. 
With this encoder the advantages of AM, in particular the simple 
means of analog-to-digital conversion, may be combined with those 
of PCM: a linear representation of the continuous signal and in many 
cases a lower transmission rate than that required by simple AM. This 
union of AM and PCM is achieved with a digital filter which may be 
readily implemented with integrated circuit devices. 

In the following sections of this paper, we demonstrate the validity 
of a transversal filter as a AM-PCM converter by reference to a 
AM-analog-PCM signal processing sequence. We then criticize the 
digital filter design method that is based on simulation of the analog 
system and we proceed to demonstrate the relevance of a mean square 
error design criterion. The associated synthesis method results in a 
class of encoders for each output signal-to-noise ratio. Within each 
class the required sampling rate is inversely related to the number of 
digital filter stages. 

II. the Am system 

Fig. 1 shows a delta modulator that transforms a continuous input 
signal y(t) to the binary sequence 

{&„} = ... ,6_ lf 6o,&, , ••• (1) 

in which t» t may have the value +1 or — 1. These binary symbols are 
generated at r second intervals; we assume that y(t) is a member of 
a class of signals band-limited to W Hz. Thus we can represent y(t) 
by a sequence of PAM samples generated at the rate of 2W per sec- 
ond. In order to simplify the AM-PCM conversion, we constrain the 
delta modulator such that its output rate, 1/t, is an integral multiple 
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of the PAM rate. The ratio of its input (AM) rate to its output 
(PAM) rate is a basic parameter of the AM-PCM converter. This 
ratio is the integer 



R = 



2Wi 



(2) 



The other basic parameter is the step size, 8, the gain of the modula- 
tor feedback loop. Assume that the linear filter in this loop is an 
ideal integrator with impulse response 



j(t) = 1 for t^ 
= for t < 



(3) 



so that the integrated AM signal, x(t), contains a step of height ±5 at 
each AM sampling instant and is constant between sampling instants. 
R and 5 determine the inherent quantizing noise of the delta modulator, 
and S, in a practical system, is selected to provide a proper balance 
between granular 9 " quantizing noise (that predominates for high values 
of 5) and slope-overload noise (the predominant form for low values of 
5). 6,6,7 In the analysis to follow, assume that no slope overload occurs; 
to make this assumption valid, we specify the parameter 5 such that 
5/r, the maximum slope of the analog signal that may be reconstructed 
from {b n }, is four times the rms slope of y(t). If y(t) is a sample function 
of a stationary time series with power density spectrum Y(j), the spec- 
trum of the time derivative of y(t) is (2tt/) 2 F(/), and the parameter 0, 
the AM step size as a multiple of rms signal amplitude, is 



= i = 8ttt/, 
a 



where we define 



1. = 



.'ii 



fY(1)df 



- Jo 



Y(f) df 



(4) 



(5) 



as the "effective frequency width" of the analog input. If / c is ex- 
pressed as a constant times W, the cutoff frequency of Y{f), it is 
clear that equation (4) is proportional to tW, so that for a given 
spectral density function, fiR is a constant. 

The AM design condition of equation (4) is identical to the one 
adopted by van de Weg 9 in his analysis of the granular quantizing 
noise of AM and it is analogous to the "4<r loading" which is the basis 
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Fig. 1 — Delta modulator. 

of Bennett's analysis of PCM quantizing noise. 10 If slope overload 
noise as well as granular noise is taken into account, analytic and 
simulation studies 6 ' 7 indicate that for minimal overall quantizing 
noise, the parameter (3R [a constant in equation (4) ] should increase 
with increasing R. For R = 32, equation (4) approximates the opti- 
mal step size, but for lower values of R the total quantizing noise in- 
herent in {b„} may be reduced if a lower 8 is accepted. A decrease in 
8 reduces the quantity of granular noise in the AM system while in- 
creasing the slope overload content. 

The analytic work reported in this paper follows Bennett and van 
de Weg by constraining the AM parameters to conform to equation 
(4) and by assuming that no slope overload occurs. [If y(t) is drawn 
from a gaussian random process, the probability that its derivative 
exceeds 8/r is less than 4 X 10 -5 .] 

III. THE AM-PCM CONVERTER 

Fig. 2 shows a AM-PCM converter that consists of an analog-to- 
PCM encoder operating on the analog signal produced by a AM 
receiver. This receiver contains a replica of the delta modulator feed- 
back loop and a linear filter that in many analytic studies is con- 
sidered to possess an ideal low-pass transfer function. This filter 
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Fig. 2 — AM-analog-PCM converter. 
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processes the integrated AM signal, x(t), and rejects the portion of its 
quantizing noise that lies outside the W Hz bandwidth of the original 
analog signal. In Fig. 2, AM signals are accepted by the converter at 
r second intervals and PAM samples are presented to the PCM quan- 
tizer every 1/2W = Rt seconds. The PAM sample that approximates 
UiR = yiSRr) is y iR = y[(jR + M)t] in which the delay of the filter 
h(-) is assumed to be Mr seconds. This output sample is related to 
!&„}, the AM input of Fig. 2, by 



ViB 



= 5 E gnb iR+M - n (6) 



where g n = g(nr) and Sg(-) is the impulse response of the AM 
receiver. Thus, g(-) is the convolution of /(•) and h('). 

In the case of single integration AM, /(•) is the unit step function 
and g{-) is the unit step response of the filter h(-), that is, 

g(t) = f h(u) du. (7) 

Jo 

Thus h( • ) may be scaled such that 

lim g n = 1 

which implies that a number N exists such that equation (6) may be 
approximated with arbitrary accuracy by 

,V-1 oo 

ViR =^E gnbjR+M-n + 5 £ &,« + «->.• (8) 

n = n-AT 

The second term in equation (8) may be realized by an up-down counter 
operating on the AM input delayed by Nt seconds. The first term, is 
the weighted sum of the outputs of a tapped binaiy shift register. The 
structure implied by equation (8) is shown in Fig. 3. 

Figure 3 represents a transversal filter with analog coefficients gen- 
erating a discrete-time analog output, j# jB }. The required quantization 
of {y jR } may be realized by means of the quantization of the filter 
coefficients.* The purpose of the converter implies the digitization of 
Fig. 3 and its implementation (with finite-precision arithmetic) as the 
entire AM-PCM converter. 



* In this paper, a PCM encoder is assumed to consist of a sampler and quan- 
tizer only. In a transmission system this encoder would be followed by a 
"channel encoder" that represents the quantized signal in an appropriate (for 
example, binary or multilevel) format. 
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Fig. 3 — Digital AM-PCM converter W(r) denotes a r second delay]. 

3.1 Simulation oj the Analog System 

If this digital converter is designed to simulate the analog-interface 
structure of Fig. 2, the filter coefficients, g„, may be derived as 
samples, separated by t seconds, of the unit step response of the filter 
h('). In order to find N, the required number of coefficients, a number 
c is chosen to represent the maximum tolerable truncation error. This 
error is bounded in the following expression 



^ 8 Z i 1 - g(nr) | ^ - f | 1 - 0i(O 

n~N T JNt 



dt. 



(9) 



Because 8/t is constant with changing sampling rates the truncation 
error requirement implies a constant value of Nt or N/R. Thus the 
number of filter stages is proportional to the AM sampling rate when 
the design procedure is based in this manner on the simulation of the 
analog interface converter. A similar conclusion was reached by 
O'Neal who employed a different simulation procedure but found 
the number of required filter stages to be N = lOE.f 

3.2 Critique oj the Analog Simulation Method 

The principal goal of the present study is to demonstrate the rela- 
tionship between the AM speed (proportional to R) and the digital 
filter complexity (indicated by N) , required to obtain PCM output 
signals of a given quality. As R increases, the difference between 



t O'Neal, J. B., unpublished memorandum relating to the computer simulation, 
the results of which are given in Ref . 6. 
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the integrated AM signal [x(t) in Fig. 2] and the analog input is 
reduced; this implies that in order to achieve a fixed output fidelity, 
the noise rejection requirements of the digital filter may be relaxed. 
It would be desirable to represent the reduced performance demands 
on the converter as a decrease in its complexity, N. Since the simula- 
tion design technique achieves the opposite result we use a minimum 
mean square error design which admits the calculation of optimum 
coefficient values for any N and the derivation of the desired trade-off 
between AM speed and converter complexity. 

3.3 Minimal Mean Square Error Design 

The converter in Fig. 3 derives an estimate of y iR that is a linear 
combination of a finite set of sample values of x(t). Thus we are able 
to use the covariance statistics of the sampled data sequences {?/,«} = 
\u(jRt)} and {x n \ = {z(tit)) to calculate optimal (with respect to 
mean square error) values of the filter coefficients. 

We consider the desired PAM sample, y iR , to be an estimate of y iR 
that is based on the statistical evidence of the AM sequence, • • • , 
b-i , b , bi , • • • , b iR +_u , beginning in the indefinite past relative to 
t = jRt and terminating with the (jR + ilf)th binary symbol. KM 
is negative, the estimation process involves prediction of y jR on the 
basis of information available (at the delta modulator) prior to t = 
jRt. In the case considered here, M will range over nonnegative num- 
bers and the estimator will have a lag of Mr seconds. 

The linear estimation design problem involves the specification 
of the infinite set of coefficients «,, in the estimation formula 



Via 



= E «,-*-A - do) 



This problem will be approached by a consideration of the sample 
values of x(t) , the integrated AM signal: 

k 

x(t) = 8 £ °» for k-T ^ t < (k + l)r. 

Each sample value, x„ = x(jit), depends on the entire histoiy of the 
AM sequence. The character of x(t) and its relation to y(t), the 
original analog signal, are illustrated in Fig. 4. Except when the 
system is in a slope overload condition, x n differs from the analog 
signal by no more than two times the step size. Thus, 

\x n - y n \ ^ 2 5. (11) 
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Fig. 4 — Analog input, y(t), and integrated AM signal, x(l). 

Equation (11) and Fig. 4 suggest that x n is closely correlated with 
y jR for values of n near JR. Such correlation implies the usefulness 
of the N = 2M + 1 samples, x jR -u, x jR , . . . , x jR+iI in the estimation 
of y jR . These N sample values comprise the statistical evidence of the 
estimate, 

M 

(12) 



$iR = S UkXjR-k 
k = -M 



Adoption of equation (12) requires the derivation of only a finite 
set of coefficients, a significant improvement over the situation sug- 
gested by equation (10). The two estimation procedures are identical, 
however, because the infinite set of a n in equation (10) may be cal- 
culated directly from the N values of a k as 



a„ = 8 /, a k 

k — M 



-M <n<ZM 



(13) 



On = 8 2-j a k = a M 

k--M 

Thus equation (12) may be rewritten, 

M 



n > M. 



b iB -, 



(14) 



n=-M n-.U + l 

which is equivalent to equation (8) with N = 2M + 1 and 8g n+A[ = a n . 
Thus the estimation procedure of equation (12) may be realized by the 
structure shown in Fig. 3. 

We now consider the mean square estimation error of equation (12) 



or 



v = E{{y iR - y iR ) 2 \ (15) 

M MM 

rj = a 2 - 2 X) a k E\y iR x jR - k } + 2 Z) ^a^lx/R-*^,^-;} (16) 

k = -M k--M l--.\t 
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where E{-} is the expectation operator. The expected values on the 
right side of equation (16) are, respectively, the cross-covariance 
function of {y jR } and {x n } and the autocovariance function of {x n }. 
It has been shown that if y(t) is a member of a stationary ensemble, 
the sequence of samples {x n } is also stationary. 11 Thus we may adopt 
the notation 

$ t = E{y iR x iR . k ) (17) 

for the cross-covariance which depends only on \k\ and 

r„ = E{x iR - k x iR .i) (18) 

for the autocovariance which is a function only of |m| = \l — k\. Equa- 
tion (16) will now be expressed in matrix notation in terms of $ and 
A defined as column vectors (AT X 1 matrices) with components $* 
and a k (— M ^ A; ^ M) respectively, and in terms of $, defined as the 
N X N autocovariance matrix with components fa.i = r,- k ( — M ^ k, 
I ^ M). Thus we have 

r, = a 2 - 2A T $ + A T +A. (19) 

If the mean value of y(t) is zero the coefficients for which rj is mini- 
mized are given by 12 

A* = f 1 ® (20) 

and the minimal mean square error is 

v m m = a 2 - SV" 1 * (21) 

which is the result of substituting A* in equation (20) for A in equation 

(19). 

The Appendix shows that when y{t) is a sample function of a sta- 
tionary gaussian process the estimation error may be expressed in terms 
of the quantizing noise correlation vector Q with components Q k (—M ^ 
k ^ M), the correlation coefficients of the error samples [y„ — x n ). 
Equation (21) may be approximated by 

^ S Q - Q T +- l Q. ( 22 ) 

IV. ENCODER CHARACTERISTICS 

The Appendix gives formulas for the correlation coefficients, r^ and 
$ fc associated with the encoding of an analog input signal that is a 
member of a stationary gaussian ensemble. These formulas have been 
applied to the calculation of filter coefficients [equation (20) ] and the 
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quantizing noise power [equation (21)] of the PCM samples gen- 
erated by optimal linear processing of the AM sequence. In particular, 
the relationships among the following three parameters have been 
investigated: (?') R, the bandwidth expansion ratio, (u) N, the num- 
ber of coefficients, and (Hi) S = oVlmta the signal-to-quantizing-noise 
ratio. 

This signal-to-noise ratio is a function of the spectrum of the 
processed signal and of N and R which have been treated as inde- 
pendent variables in the calculations. In a practical design procedure, 
S would be the independent variable, specified according to the system 
fidelity criterion. With S fixed, N and R vary inversely; in practice 
their values would be selected as a compromise between the objectives 
of achieving low AM speed (low R) and a simple converter structure 

(low JV). 

Figure 5 pertains to a system whose gaussian input process has a 
flat spectrum band-limited to W Hz. The solid curves show S as a 
function of R for various values of A r and the broken curve indicates 
the result of optimal analog processing of the integrated AM signal. 
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Fig. 5 — Performance curves, flat spectrum. 
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This curve, the ratio of a 2 to -q x [see Appendix, equation (42)], is a 
bound on the solid curves. It corresponds to the signal-to-noise ratio 
of a transversal filter with an unlimited number of stages. The slope 
of the broken curve is 30 dB/decade. 

The lowest curve in Fig. 5 indicates the signal-to-noise ratio of the 
encoder with a digital filter with one coefficient. For R ^ 16, this coef- 
ficient may be set equal to unity with little (less than 0.5 dB) loss in 
estimation accuracy. With a unit coefficient, the converter reduces to 
an up-down counter alone, and the encoder consists only of a delta 
modulator and a counter as shown in Fig. 6. In this case each PCM 
output is a sample of the integrated AM signal, x(t). Sampling this signal 
(whose bandwidth is RW Hz) at the Nyquist rate of the analog input 
results in aliasing of the high frequency noise components of x(t) into 
the W Hz signal band of the coded signal. The noise power in the output 
of Fig. 6 is the entire mean square error of {x„\, 

Qo = E{(y n -x n ) 2 }^8 2 /S, (23) 

so that the signal-to-noise ratio increases with AM speed at the rate of 
20 dB/decade. 

The effect of setting N = 3, which involves the addition of a 2-stage 
tapped binary shift register to Fig. 6 is (for R ^ 16) a signal-to-noise 
ratio improvement of more than 7 dB or a AM speed reduction by a 
factor of 2.4 for a fixed value of S. Two additional stages (N = 5) 
further increase S by 2 dB or reduce the AM speed required for fixed 
S to less than one-third of that required when only an up-down counter 
is employed. Figure 5 demonstrates the manner in which further 
(through diminishing) improvements are obtained with the incorpora- 
tion of additional coefficients and stages of delay. 

Notice some of the functions that the transversal filter may be said 
to perform. In particular its noise reduction effects may be viewed 
as the result of filtering in the frequency domain, of statistical esti- 
mation, or of digital interpolation. Viewed as a substitute for the 
analog filter in Fig. 2, the transversal filter may be said to reject the 
out-of-band components of the error signal, y(t) — x(t). As the num- 
ber of stages increases, the filter cutoff becomes sharper and the 
output noise power is reduced. 13 Considered as an estimator of a 
random variable, the filter bases its estimates on an increasing number 
of correlated data as N increases. The quadratic form, Q T \p'' 1 Q, con- 
sisting of correlation coefficients, increases with increasing N and 
therefore the output noise power given by equation (22) decreases. 
Finally, the filter may be viewed as an interpolator. As the number 
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Fig. 6 — Encoder structure for N = 1. 

of filter stages increases, the AM speed may be decreased and a 
proportionally greater step size may be tolerated in the delta modu- 
lator. The resolution of the AM signal is thus reduced while the 
accuracy of the PCM output is maintained due to the interpolation 
performed by the digital filter between increasingly separated AM 
quantization levels. 

4.1 Digitization of Coefficient Values 

The data of Fig. 5 apply strictly to an analog estimate obtained 
with analog coefficients. ("Analog" numbers in this context mean 
numbers quantized to the precision of the numerical methods used in 
calculating the coefficient values.) In a practical application of the 
AM-PCM conversion method, the coefficients would exist in digital 
form; in order to investigate this situation, we will consider the effect 
of rounding the values of the derived coefficients to a limited number 
of binary places. 

In the discussion that follows, it will be convenient to divide equa- 
tion (14) by S and to consider the estimator of Vjr/8, given by 



n U n = M 



(24) 



in which y< = ai/8. The coefficients of equation (24) are related to 
the components of A, the coefficient vector, by the sums 



Tn = £ a* 



-M <n < M. 



(25) 



In the digitization of the AM-PCM converter, the set of analog 
coefficients, j-m, • • • , y©> ■ • • > yu, is rounded to L binary places by 
means of the computation 

y { (L) = 2" <L_1) X [the greatest integer ^ 2 Ci " 1) 7,- + 0.5]. (26) 

Corresponding to the limited-precision coefficients of equation (26) 
is a quantized coefficient vector, 

A{L) = [a. u (L), •■■ , ao(L), • • • , a M (L)] T , 
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whose components are calculated according to 
a- M (L) = y- u {L) 
a { {L) = 7i (L) - 7 ,-,(i) -M + lgigM. (27) 

The mean square error of the digitized converter may be calculated 
from equation (19), 

r,(L) = a 2 - 2[A(L)] T *A(L) + [A(L)ffA(.L). (28) 

For each estimator considered in the derivation of Fig. 5, the signal- 
to-noise ratio, <T 2 /rj{L), has been computed for L = 1, 2, . . . , 15 
binaiy places in each coefficient. 

Under the assumption that the quantization of coefficients is not 
allowed to degrade the signal-to-noise ratio by more than 0.5 dB, 
Table I has been obtained. L* in this table is the minimum value of 
L for which the inequality 

10 log [n(L)/ Vmin ] < 0.5 

is valid over all R ^ 10. 

When the coefficients are rounded to L* places according to Table 
I, we find in every case that yji(-k) = 1 so that equation (24) may 
be specified as 



v -f = £ yn(L*)b iS - n + E &«- • 

O n--M n = M 



(29) 



The second summation in equation (29) is the output of the up-down 
counter (which requires no weighting) ; the first summation may be 
implemented by means of a tapped binaiy shift register with 2M = N 
— 1 stages. 

It is also the case that for n < M, y„(L*) < 1, so that each of 
the N — 1 tap weights is a proper binary fraction that may be rep- 
resented by L* — 1 bits. The output of the counter ranges over the 
set of integers and the tapped shift register serves as an interpolator 
so that the resultant PCM output is more finely quantized than the 



Table I — Effect of Coefficient Round-Off 




Required coefficient accuracy (L*) 


1 


4 


4 


5 


7 


8 


Number of coefficients (N) 


1 


3 


5 


9 


17 


33 
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sample values of the integrated AM signal, of which it is a weighted 
sum. 

4.2 Other Signal Spectra 

The data of Fig. 5 relate to the processing of analog input signals 
that possess a flat band-limited spectrum. Converter performance 
characteristics have also been obtained for analog input signals with 
spectral density functions of the general form 

Jc tan 



f. ' (30) 

= | / | > w. 

Such spectra result when band limited white noise is processed by a 
low-pass RC filter with corner frequency f c = 1/RC. 

Corresponding to the examples analyzed by O'Neal, two spectra 
conforming to equation (30) have been considered. 6 In one case the 
ratio fc/W, of corner frequency to cutoff, is 0.25 and in the other case 
this ratio is 0.068. These spectra relate to broadcast television and 
Picturephone® visual telephone signals, respectively; the perform- 
ance curves are given in Figs. 7 and 8. The shapes of these two 
families of curves are similar to one another; both resemble the 
curves in Fig. 5. The principal difference betwen any two correspond- 
ing curves is a vertical translation whose magnitude is the squared 
ratio, expressed in dB, of the two relevant step sizes. 

Thus, for any of the three spectra considered and a given N and 
R, the signal-to-noise ratio in dB is approximately the value of S 
given in Fig. 5 plus the correction 

-10 log [3//] dB. (31) 

(For signals with a flat spectral density function / „ 2 = ^.) 

For spectra in the form of equation (30) , this correction is 6 



= 11.35 dB for f c /W = 0.25 
= 16.89 dB for jJW = 0.068. 
For speech signal processing, realistic analytic results are more 
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Fig. 7 — Performance curves, RC spectrum, f e /W = 0.25. 

portion of the speech spectrum to be conveyed depends on the ap- 
plication. A particularly severe problem arises when a range of signal 
levels must be accommodated by the encoder. To treat this problem, 
it may be possible to introduce companding to the delta modulator; 
but the solution currently favored is the acceptance of a higher AM 
sampling rate than would be required if the signal level were fixed 
and the introduction of a digital compandor 14 to operate on the 
uniformly quantized signal produced by the AM-PCM converter. 

4.3 A Design Example 

This section demonstrates the form of a converter designed to process 
the digital representation of analog signals with a band-limited RC 
spectrum in which f e /W = 0.06S. We assume that a PCM signal-to- 
noise ratio of at least 41 dB is required, and refer to Fig. 8 to determine 
values of N and R for which this requirement may be met. For each value 
of N illustrated in Fig. 8, the required R is given in Table II. Thus the 
converter in which N = 5 and R = 24 meets the stated objective. Table 
HI gives the optimal coefficients a, , a, , and the limited precision set, 
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Fig. 8 — Performance curves, RC spectrum, jc/W = 0.068. 

7,(4), for — 2 ^ i ^ 2. The signal-to-noise ratio associated with the 
analog coefficients is 41.9 dB and that associated with the coefficients 
rounded to four binary places is 41.8 dB. (When the coefficients are 
limited in precision to three binary places, the value of S is reduced to 
39.9 dB.) 

Figure 9 demonstrates, in the schematic form of Fig. 3, one imple- 
mentation of the converter. The indicated arithmetic operations need 
be performed only once for every 24 AM inputs accepted by the conver- 
ter. These operations consist of modification of the sign of each coef- 
ficient (multiplication by ±1), addition of four 3-bit numbers, and 
addition of their sum to the counter output. The sign modification and 
coefficient addition operations (shown in the broken box) may be per- 
formed by a combination of Boolean logic elements with four binary 



Table II — Values of N and R for S > 41 dB in Fig. 8 



R 


67 


29 


21 


18 


17 


15 


13 


N 


1 


3 


5 


9 


17 


33 


CO 
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Table III — Converter Coefficients, A r = 5 


i 


a ■ 


ai 


7.(4) 
(binary form) 


-2 

-1 



1 

2 


0.15996 
0.22575 
0.22866 
0.22575 
0.15996 


0.15996 
0.38571 
0.61437 
0.84013 
1.00009 


0.001 
0.011 
0.101 
0.111 
1.000 



inputs and five outputs. Because the logical processor is required to 
operate during only one of every 24 basic time intervals of the system, 
the possibility exists for it to be shared among other digital signals. 
Notice that, in general, for converters in which N = 5, it has been 
found that coefficient values may be truncated to four binary places 
without unacceptable degradation of converter performance. Further- 
more, the coefficients, y t (4), have, in general, the values given in 
Table III. Thus, regardless of the spectrum of the analog input and 
the sampling rate and step size of the delta modulator, the same 
converter structure may be employed to produce a near-maximum 
(within 0.5 dB) PCM signal-to-noise ratio. This signal-to-noise ratio 
is a function primarily of the step size of the delta modulator. Except 
in the manner that it determines the step size [through equation 
(4) ] , the precise shape of the spectrum of the input signal has only 
a secondary influence on system performance. With regard to the 
AM sampling rate, variations in R affect the converter only by vary- 
ing the number of AM inputs accepted between the generation of 
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Fig. 9 — Converter structure for N = 5. 
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PCM outputs. The configuration of the logical processor (arithmetic 
unit) is not altered by changes in AM sampling rate. 

V. CONCLUSIONS 

The PCM encoder described combines the principal advantage of 
delta modulation, a simple means of analog-to-digital conversion, 
with the advantages of PCM, a linear representation of the coded 
signal and often fewer bits per second than are required with AM. 
The result of adopting the minimum mean square error criterion, in 
the synthesis of the AM-PCM converter, is a family of encoders for 
each possible level of output quantizing noise and thus considerable 
design flexibility. 

The transversal filter in the converter has a particularly simple 
configuration. The sequence of signals to be processed is represented 
by one bit per sample so that the only required arithmetic operations 
are addition and subtraction of prespecified coefficient values. These 
coefficients may be rounded to a modest number of binary places and 
the digital filter may be considered to be a combination of elementary 
Boolean logic elements rather than an arithmetic unit. With the 
exception of the up-down counter, the elements of the AM-PCM 
converter may be time-shared among several signals. 

In addition to being applicable as a general-purpose PCM encoder, 
the device described in this paper may be adopted to serve in a digital 
communication system which performs local office switching of signals 
coded in a AM format and trunk transmission of PCM signals. In 
this application there would be a AM modem for each analog station 
and a limited number of AM-PCM converters for processing trunk 
calls. Elements of such a system are shown schematically in Fig. 10. 

APPENDIX 

AM Signal Statistics, Gaussian Inputs 11 

Expressions have been derived for the matrices required in the ap- 
plication of equations (20) and (21) to the determination of filter coef- 
ficients and values of noise power under the assumption that y(t), the 
input to the delta modulator, is a member of a gaussian ensemble. The 
correlation coefficients <p 4 and r^ are presented in this section and the 
following section expresses the AM and PCM quantizing noise char- 
acteristics in terms of these correlation characteristics. 

The covariance statistics are expressed as functions of the AM step 
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Fig. 10 — An application in which the delta modulator and the AM-PCM 
converter are separated. 

size, 5, its normalized value, = 8/a, and the correlation coefficients of 
the analog input, 



Pk = -r 2 E\y{m)y[{n + k)r]\. 
a 



(33) 



These coefficients are samples, taken at t second intervals, of the 
autocorrelation function, P (-), of y(t). The power density spectrum, 
Y ( ■ ) , is the Fourier transform of a 2 p ( • ) . 

The cross-covariance of the integrated AM sequence, {x n }, and the 
samples of the analog input, {ym}, is proportional to the autocovari- 
ance of {?/;}. Thus, 

( oo r q 2 h 2 ~\ 

*„ = **{l + 2 £ exp -^ 

and in general 

#* - p A -$o ■ (34) 

For the autocovariance of {x„}, we have the more complicated 
formulas: 



r n = o 



2tt k 
P J 



r» = p^ 



{l +4 |;exp[-^]} + .{| + |:^ex T [. 



/ r - 

•jexp I 



(k 2 + m 2 - 2mk Pll ) 
2/3 2 



exp 



7r 2 (fc 2 + m 2 + 2w/bp M ) 
2/3 2 

for n even 



11 
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r„ = py{ 1 + 4 X) exp 



exp 



x 2 (/c 2 + m 2 - 2mfcp,) 
20 2 



2£ 

2 

7T 

exp 



7r 2 (fe 2 + m 2 + 2mfcp M ) "|\ 
2/3 2 J/ 



for /i odd . (35) 

In most cases of practical interest, the AM step size is a fraction of 
the rms input signal and the formulas in equations (34) and (35) 
may be simplified considerably. All of the single summations in 
these formulas involve powers of 



exp [~t\ = exp rWi ' 



which for (3 < 0.5 is less than 10~ 34 . In this event we have the very 
accurate approximations 

$ ^ a 2 and r £* a 2 + 5 2 /3. (36) 

In the formulas for 1\ , there are double sums of the difference of two 
exponential terms. When equation (36) applies, the second term is 
negligible and the first term has significant values only when the two 
indices of summation are equal. We thus have the approximation, 



Tu = Pu<T 



25 2 ^(-iy 

-5- 2-, ,„2 exp 



2 k 2 (l - p») 



]■ 



(37) 



which is valid in most cases of practical interest. 



A.l Quantizing Noise 

A consideration of the statistical properties of the quantizing noise 
signals that appear in the analog-AM-PCM encoder provides insight 
into the signal processing operations described in this paper. In the 
delta modulator, we have the error signal y(t) — x(t), that is sam- 
pled and quantized to produce the AM sequence, {b„}. This is a high 
frequency signal with effective bandwidth RW; the filter, h(-), in 
the AM-analog receiver of Fig. 2 has the role of rejecting its out-of- 
band components. Similarly, the digital AM-PCM converter rejects 
an increasing proportion of the power of the error signal as N, the 
number of filter stages, increases. Equation (6) indicates that the 
performance of a digital AM-PCM converter with an unlimited num- 
ber of stages (N = oo) is equivalent to that of the analog-interface 
converter of Fig. 2. 

The autocovariance coefficients of {y n — x„], the sequence of 
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error samples, are 

Q k = E{{y n - x n )(y n+k - x n+k )} = <r 2 Pk + r k - 23> k . (38) 
Equations (34) and (38) may be combined in the expression 

*o . C 



$ t = 



(r h - Q k ) = 



2* - a 
in which we have set 

C = h « 1 + 2 £ exp 



2C - 1 



(n - Q k ) 



(39) 



2ir 2 lc 
' /3 2 



1- 



Equation (39) may now be substituted into equation (21) for minimum 
mean square error, 7] mln . Appearing in the resulting expression for ij min 
are the terms r 7 "^ -1 and yf/~ l r in which r denotes the column matrix with 
components r k {—M ^ k ^ M). The two matrix products are transposes 
of one another; both are identical to quite simple matrices. Thus, 

rV = [0, 0, • ■ • , 1, • • • , 0, 0] = [r'rf. (40) 

When equation (40) is applied, equation (21) may be expressed in 
terms of the quantizing noise statistics as 



*7m,n = 



(Oo - Q T r l Q) - 



(c - iy 



(41) 



k2C - 1/ v *° x Y x/ 2C - 1 ' 

in which Q is the error covariance vector and Q is the total power 
in the error signal, {y n — x„}. Thus Q T \p~' y Q represents the amount 
of noise rejected by a digital filter whose coefficients are given by 
equation (20). Because \p is positive definite, equation (41) indicates 
that such a filter cannot enhance the quantizing noise power of the 
system. 

As N increases without limit, the mean square error approaches 
the quantizing noise power associated with the optimum analog in- 
terpolation filter of the AM signals. This quantity may be expressed 
in terms of the signal spectra as 11 



t]„ = lim 77„ 



c 



2C - 1 



Qo + 2 E 



i irk 



Jo 



[E*(jW)Y 



(2C - 1) Y*(jW) + E*(jW) 



df 



(c - iy 

2C - 1 



(42) 
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in which Y*(*) and #*(•) are the power spectral density functions 
of {y„}, the sampled analog signal, and {y n - x n ), the sampled error 
signal, respectively. Thus 

Y*(fW) = A I + 2 £ Pk cos ^1 - - t, Y[W(f + 2nR)} (43) 

L i = l ^_ T n--oo 

and 

#*(/T*0 = Q + 2 £ Q* cos ^- (44) 

The sum in equation (42) of Q and the infinite series is the quantiz- 
ing noise at the output of an ideal low pass filter with bandwidth W 
Hz. The integral represents the additional noise power reduction 
that results from an optimal, rather than a flat, filter transfer function. 
When the approximations given in equations (36) and (37) are 
valid, the correlation coefficients that appear in equations (41) and 
(44) may be approximated by 



>.*! 



(45) 

^tt 2 & fc 2 exp L ^ 2 J 
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